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ABSTRACT 

In  [4],  we  treated  the  problem  of  passage  through  a  discrete-time  clock- 
regulated  multistage  queueing  network  by  modeling  the  input  time  series  a„  to 
each  queue  as  a  Markov  chain.  We  showed  how  to  transform  probability 
transition  information  from  the  input  of  one  queue  to  the  input  of  the  next 
one  in  order  to  predict  mean  queue  length  at  each  stage.  The  Markov  ap- 
proximation is  very  good  for    p  =  E{a„)<^^,  which  is  in  fact  the  range  of 

practical  utility.  Here  we  carry  out  a  Markov  time  scries  input  analysis  to 
predict  the  stage  to  stage  change  in  the  probability  distribution  of  queue 
length.  The  main  reason  for  estimating  the  queue  length  distribution  at  each 
stage  is  to  locate  "hot  spots",  loci  where  unrestricted  queue  length  would 
exceed  queue  capacitym  and  a  quite  simple  expression  is  obtained  for  this  pur- 
pose. 
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1.  Introduction  and  Summary  of  Previous  Results 

The  unit  element  of  the  network  we  consider  [1]  will  be  a  2  x  2  buffered  switch,  which 
we  can  regard  as  a  system  of  two  queues  working  in  parallel,  each  one  with  a  deterministic 
server  of  unit  serving  time.  A  message  entering  either  of  the  two  inputs  of  the  switch  goes 
with  probability  1/2  to  either  of  the  two  output  queues  of  the  switch.  Each  queue  out- 


out 


Fig.  1.2x2  buffered  switch, 
puts  one  message  per  clock  cycle  unless  it  is  empty.  Any  node  in  this  network  will  then 
see  a  time  series,  each  element  of  which  signifies  the  presence  or  absence  of  aji  information 
packet  to  be  transmitted  to  the  next  node.  Thus,  we  are  observing  the  transformation  of 
a  discrete  time  series  by  the  basic  processes  of  passage  through  the  queue  and  of  mixing. 
Suppose  the  inputs  to  the  switch  at  time  n  axe  denoted  by  /„  and  I^ ,  each  taking  the 
value  0  or  1.  K  we  confine  our  attention  to  the  upper  chaimel,  then  according  to  the  rule 
of  mixing, 


(1) 


On+l  =  7nA   +7'„I'„ 


will  arrive  at  the  head  of  the  upper  queue,  where 


(2) 


7„  =  ■^         with  probability 


I  1 


1/2 


and  similarly  for  7^ .  The  streams  {7^  }  and  {7^  }  are  i.i.d.  random  variables.  Now,  if  the 


queue  had  length  S„  to  start,  then  at  the  end  of  the  clock  cycle 

S„+i  =  S„  +  a„+i  -  1  +  6„  -1-1 

(3)  J  1  5„  +a„+i  =  0 

where  (5„+i  =  |         if 

0  otherwise 

or  equivaiently 

(4)  Sn+i  =max{S„  +a„-|.i  -  1,0} 
Furthermore,  the  output,  which  is  given  by 

(5)  0„+l  =  l-<5„+i  , 

serves  as  input  for  the  next  stage.  Evidently,  the  above  can  be  taken  over  unchanged  to 
the  operation  of  the  lower  channel  and  associated  queue.  Although  the  outputs  of  the  two 
channels  are  clearly  correlated,  matters  may  be  arranged,  e.g.  in  the  Q-network  [1],  so 
that  they  and  their  progeny  never  meet  again  as  joint  inputs,  and  so  this  correlation  will 
not  be  investigated. 

The  picture  we  have  in  minde  is  that  of  a  network  of  switches.  This  means  that  at  a 
given  switch 

(6)  L  =  o„ ,  /:  =  oi , 

where  0„  and  0„  are  outputs  from  previous  switches.  We  will  be  interested  in  steady 


Fig.  2.  Section  of  network, 
state  operation,  described  by  the  basic  flow  parajneter 


(7) 


p=E{J„}  =  E{a„}, 


in  terms  of  which 


(8) 


/.  =  PK  =. ,  =  (f)  (£)'(! -ff- 


More  detailed  information  is  supplied  by  the  transition  probabilities 


(9) 


PO  =  P{h    =1    A-1   =  0}    ,         Pl   =  P{In    =1    U„-1   =  0} 


Since  p  =  P{I  =  1}  =  po(l  —  p)  +  P\Pi  Eq.  (9)  is  more  conveniently  written  as 


(10) 
where 


2p 

pi  =  2(p  +  gr),      po  = {q-p-2qr) 

q-p 


(11) 


p  =  p/2,      q  =  l-p/2 


emd  r  is  a  normalized  depart  ure  from  independence 


(12) 


r  = 


Pi-  P 
2-p 
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[q  +  prf 

q{q  +  pr){\  -  r) 

qHl-r? 

2p{q  +  pr){\  -  r) 
1 

2p5(l-r)2  +  r 

2q{p  +  qr){l  -  r) 

1                     P'(l  -  r? 

p(p  +  gr)(l-r) 

(p  +  qr? 

It  is  an  easy  exercise  to  show  [4]  that  the  input  transition  probabihties 

(13)  -  Q,,'  =P{a„  =k  I  a„_i  =  k'} 

are  then  determined  by  (1)  as 

k'  0  1  2 

k 

0 
1 
2 

Table  1.  The  transition  matrix  Qkt'- 

If  we  restrict  ourselves  to  the  case  that  {a„  }  is  modeled  to  lie  in  the  class  of  Markov  time 
series,  the  above  information  allows  us  to  use  (3)  to  compute  the  steady  state  development 
of  the  random  variable  S„  at  any  stage  without  simultaneously  developing  the  full  time 
series  {a„  }  —  we  simply  follow  Qkk'  -,  or  equivalently,  r,  from  stage  to  stage.  In  particular, 
we  found  [4]  without  difficulty  that  passage  through  a  switch  transforms  r  to 

(14)  r'  =  ^^(p+2qr+pr^)  . 

4q 

With  the  Markov  model,  we  also  foiuid,  with  a  certain  amount  of  effort,  that 

(16)  £(5.)  =  ji-i±I. 

q  —  p   1  —  r 

Compaxsion  with  computer  simulations  showed  this  to  be  in  general  a  lower  bound  to 
the  exact  result,  but  to  be  very  accurate  for  p  <  1/2,  which  is  the  practical  domain  of 
operation.  Our  objective  now  is  to  extend  this  result  to  the  full  distribution  of  Sn  ■  The 
reason  is  a  practical  one:  queues  have  finite  capacity.  If  a  message  arrives  at  a  queue  which 
is  full,  a  new  mode  of  operation  must  be  entered.  It  is  thus  important  for  design  purposes 
to  know  how  likely  a  given  mode  is  to  develop  such  a  "hot  spot",  and  this  is  what  we  will 
determine. 


2.  The  Steady  State  Probability  Distribution  of  Queue  Length 
Our  objective  now  is  to  obtain 

(16)  Ei{e")=   hm  E,{e''-}  , 

n  — »  CO 

the  generating  function  for  the  steady  state  queue  size  at  the  i^^  stage  of  the  system. 
Suppose  that  the  input  sequence  {a„  }  to  the  i  stage  is  given.  Thus  according  to  (3),  and 
using  6^  =  Sn,  we  have 


(17) 


g«S„    _  g'On     g'(*»-l)    e'5--l 


=  e"'"(e-'+(l-e-')«5„)e'^" 


But 

(^^)  <^n    =  <5<,_0^S,_,,0    , 

and  so  we  can  write 

e'5,  =e'("»-l)e'^-'+(l-e-')6.,,o<^s„    .0 
(19) 

=  (e-'+(l-e-')r)e'"-e'^"-'  , 

where  T  is  the  operator  defined  by 

(20)  Th{t)  =  h{-oo) 

On  iterating  (19),  it  follows  that 

1 

(21)  e'^"  =  n  [(«"'  +  (1  -  e-')r)e""-]e'^°  . 

Thus  far,  there  is  no  approximation.  Now  however,  we  assume  that  the  input  time 
series  is  Maxkovian,  with  transition  matrix  given  by  Table  1  and  parameter  r  appropriate 
to  the  stage  in  question.  Hence 

1 

(22)  PK,...,ai}=i;  n  Qa.a..,p(ao), 


and  if  the  process  is  started  at  So  =  0,  then  (21)  imphes  that 

1 

(23)  £{6''"}=       E        n[(e-'+(l-e-')r)e'-g,.,._J.p(ao) 

Introducing  the  diagonal  matrix 

(24)  A^^.  =  aSaa-  , 
Eq.  (23)  takes  on  the  concise  form 

(25)  E{e''-}  =  E  [(e-'  +  (1  -  e-')T)e'^  Q]:,,  .p{a')  , 
SO  that  we  must  examine  the  properties  of  the  operator 

(26)  A  =  (e-'+(l-e-')T)e'^Q. 

A  may  be  regarded  as  operating  on  the  product  space  of  input  3-vectors  times  power  series 
in  e' .  A  is  positive  on  this  basis,  and  is  stochastic: 

(27)  E  A,,,P,,(e')|,=o  =  E  e"'Q...F„-(e')|,=o  =  E  ^.'(1)  • 

aa'  aa'  a' 

It  follows  that  the  steady  state  limit  n  — +  oo  of  (25)  exists,  and  is  determined  by  the 
eigenspaces  of  the  maximal  eigenvalue  A  =  1  of  A. 
We  now  have 

(28)  Hm  E(A")aa'P(a')  =  A'E  U^) 


n— •  oo 

aa' 


where  {/a(i)}  is  the  eigenvector  belonging  to  A  =  1,  and  K  a  suitable  constant.    Since 
■^{^'^''  }|<=0  =  1)  this  means  that 

(29)  £{e'"}=E/a(0/    E/a(0) 

a  a 

where 

(30)  (e-'+(l-e-')r)e'^g/(0  =  /(0- 
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In  order  to  solve  (30),  we  rewrite  it  as 

(31)  (/  -  e'(^-')Q)  m  =  (1  -  e-')  3^^'^  Qfii) 
and  then  define 

(32)  g  =  Te'^  Q  /(<) 
so  that 

(33)  fit)  =  {I-e'^^-'^Q)-Hl-e-')g  . 

Hence 

g  =  Te'^Q{I-e'^^-'^Q)-\l  -  e-')g 
=  T(e'  -  1)  e'(^-^)Q(/  -  e'(^-^^Q)-^5 

(34)  =-T  e'^^-'^Q(I-e'^^-'^Q)-'^g       ■ 

=  .T{{I-e'^^-'^Q)-'^-I)g 

=  g-T{I-e'^^-'^Q)-^g 

or  simply 

(35)  T(/-e'(^-^)g)-^g  =  0. 


It  is  readily  verified  that 
(36) 

r(/-e'(^ 


/O     Qoi       QoiQi2  +  Qoi(l-Qii)  \  I 

Og)-i=      0     -Qoo  Q10Q02  -  Q00Q12  /(-Qoo(l-<?ii)-<?oiQio)| 

\0       0       -Qoo(l-Qii)-QoiQio/  I 


and  so  (35)  implies  that 

(37)  .=  ^0^ 


From  (33),  then, 

(38) 

or,  using  the  fact  that  Q  is  a  stochastic  matrix  to  ehminate  the  Qoa  i 


(39)     EMt)  = 


1  1  1 

-Qio     1  -  Qii       -Qi2 

-e'Qso      -e'Q21      l-e'Q22 


1  0  -e-' 

-QlO       1  -  Qll  -Ql2 

-e'Q20      -e'Q21      l-e'Q22 


On  inserting  the  expUcit  Q^a'  from  Table  I,  we  then  have 
^  f,{t)  =  C-De'  I  A- Be' 

a 

where  A  =  (1  -  Q2o){l  -  Qu)  -  Q12Q21  =  (1  -  r){q  +  pr)^ 

B  =  Q2i{l  -Qn)  +  Q21Q12  =  (1  -  r)(p  +  9r)2 
(40) 

C  =  1  +  Qio  -  gii  =  (1  -  r)(l  +  2pr) 

D  =  {Q22  -  Q2o)(l  -  Qii)  +  (Q21  -  Q2o)C?i2  +  (Q22  -  Q2l)QlO 

=  (1  -r)r(2p  +  r)  , 
and  therefore  conclude  from  (29)  that 


(41) 


^{e'^}  =  (g-p)[(l+2pr)-r(2p  +  r)e']  /  [(?  +  pr)^  -  (p  +  gr)V]  . 


3.  Discussion 
An  immediate  result  of  (41)  is  the  expected  length  of  the  queue: 

E{S}  =  ^enE{e'']l=o 

q  —  p   1  —  r 
as  well  as  the  variance 

(43)  2  2       1    , 

(5_p)24_r^         -^   (l-r)2  " 

For  successive  stages  in  a  network,  we  have  seen,  (14)  that  starting  at  ri  =  0  corresponding 

to  independent  previous  output  [2,3] 

(44)  r.  +1  =  i-^  (p  +  2qr,  +  prf )  . 

4q 

The  mean  queue  length  can  thus  be  followed  through  a  network  in  Mcirkov  approximation, 
and  compared  with  computer  simulation.    The  results,  as  we  have  mentioned,  are  quite 
good  for  p  <  0.5,  and  this  is  true  for  the  variance  as  well.  This  encourages  us  to  use  (41) 
to  compute  the  full  queue  length  distribution.  We  have  immediately  from  (41) 
P{S=  k}  =coef  e'*  ini;{e'^} 

(45)  _U.-P)j^,  ^  ^^^  *  =  0 


^{q-p) 


14-2pr       _    r(r+2p) 


^      ,        ^>o, 


where  at  the  i      stage,  r  is  set  equal  to  r,  of  (44). 

It  is  easily  seen  that  for  p  <  i ,  r,  of  (44)  increases  monontonically  with  i  to  a  value 
which,  with  negligible  error,  is  given  by 

p    1  -2p 

The  corresponding  distribution  (45),  for  small  p,  reduces  to 
(47)  p{S=^>0)~i(2<^)". 

10 


We  therefore  have  a  simple  estimate  for  the  frequency  P  at  which  a  queue  of  capacity  k 
near  the  termination  of  the  network  saturates  under  mean  flow  p  =  2p. 
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